
FILTERING FOR TIMING DISTRIBUTION SYSTEM 
IN NETWORKING PRODUCTS 

FIELD OF THE INVENTION 

The present invention is related to a timing distribution 
5 system for a network- switching product. More specifically, the 
present invention is related to a timing distribution system for a 
network- switching product that removes jitter with a first filter 
and removes wander with a second filter. 

BACKGROUND OF THE INVENTION 

l~10 The present invention is related to a timing distribution 

■serf 

*-J system has been developed for a network- switching product that 

SS" corrects several non-compliant features from previous systems. 

M The limitations that have been addressed are: 

Being able to successfully accept a wide range of 
wandering and jittering inputs that produce the 
same output when filtered. 

Having a range of inputs accepted that may actually 
be outside of the acceptable range for a timing 
distribution system. 

Being unable to monitor the frequency of a standby 
reference signal in order to approve it prior to 
the failure of a master reference signal. 
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Being unable to monitor the frequency of a standby 
reference signal in order to provide revertive 
switching to a previously failed signal . 
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5) Having no phase discontinuity when switching over 
to a standby hardware system. 

6) Not having any phase discontinuity whatsoever when 
failing between any like frequency reference. 

5 This system is believed to be the first of its kind that 

completely meets all of the industry specif icaLtions for timing 
distribution systems in a network- switching product (Bellcore 
GR-1244-CORE and GR-253-CORE, Chapter 5, both of which are 
incorporated by reference herein) . 

QlO SUMMARY OF THE INVENTION 

12 The present invention pertains to a timing distribution 

M3 apparatus. The apparatus comprises a source for producing a 

* rs signal. The apparatus comprises a first filter for removing jitter 

M from the signal. The apparatus comprises a second filter for 

ml5 removing wander from the signal separate arid apart from the first 

in filter. 

G 

The present invention pertains to a method for producing 
a timing distribution signal. The method comprises the steps of 
removing jitter from a signal with a first filter. Then there is 
20 the step of removing wander from the signal with a second filter 
separate and apart from the first filter. 

The present invention pertains to a timing distribution 
apparatus. The apparatus comprises a master hardware system and a 
backup hardware system for the master hardware system that allows 
2 5 the master hardware system to fail without any phase discontinuity. 
Each hardware system comprises a first filter for removing jitter 
from the signal. There is a second filter for removing wander from 



the signal separate and apart from the first filter. The master 
hardware system has a first master signal and a second master 
signal that are sent to the back up hardware system that informs 
the backup hardware system that the master hardware system is a 
5 master over the backup hardware system and, it is either in a 
failed or non-failed condition, respectively. The master hardware 
system produces a timing distribution signal that is sent to the 
backup hardware system which the backup hardware system uses as a 
reference signal for the backup hardware system but the backup 
10 hardware system does not transmit any timing distribution signal if 
it is not the master. When the master hardware system enters a 
~& failed condition, the backup hardware system immediately becomes 
*-4 the master and the backup hardware system continues to transmit the 

l . i 

2| timing distribution signal that the master hardware system was 
M=15 producing before it failed with the timing distribution signal from 

}z the backup hardware system aligned with the timing distribution 

y i 

s signal produced by the master hardware system before it failed so 

"l" there is no phase discontinuity. 

n i 
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if! The present invention pertains to a method for producing 

f 

J5J2 0 a timing distribution signal. The method comprises the steps of 
producing the timing distribution signal, a first master signal and 
a second master signal with a master hardware system. Then there 
is the step of receiving the first master signal, second master 
signal and timing distribution signal at a backup hardware system 

2 5 which informs the backup hardware system that the master hardware 
system is a master over the backup hardware system, it is in either 
a failed or non- failed condition, and which the back up hardware 
system uses as a reference signal but the backup hardware system 
does not transmit any timing distribution signal if it is not the 

30 master, respectively. Next there is the step of entering the 
master hardware system in a failed condition. Then there is the 
step of having the backup hardware system immediately becoming the 
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master and continuing to transmit the timing distribution signal 
that the master hardware system was transmitting before the master 
hardware system failed and stopped transmitting its timing 
distribution signal, with the timing distribution signal from the 
5 backup hardware system aligned with the timing distribution signal 
provided by the master hardware system before it failed so there is 
no phase discontinuity when the backup hardware system becomes the 
master and begins transmitting the timing distribution signal. 

BRIEF DESCRIPTION OF THE DRAWINGS 

%nlO In the accompanying drawings, the preferred embodiment of 

^ the invention and preferred methods of practicing the invention are 

v * 

f=j illustrated in which: 

1% Figure 1 is a schematic representation of the system of 

= the present invention. 

pl5 Figure 2 is a flow chart regarding the operation of the 
present invention. 

s ; 
•ass 
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Figure 3 is a comparison of the acceptable variance of 
the present invention as opposed to prior art. 

Figure 4 is a schematic representation of the system of 
2 0 the present invention in regard to how the signals are connected 
between the master timing control hardware and the standby timing 
control hardware. 



Figure 5 is a flow chart showing the steps involved in 
the transfer from the active to the standby reference. 



Figure 6 is a schematic representation of the system of 
the present invention. 

DETAILED DESCRIPTION 

Referring now to the drawings wherein like reference 
numerals refer to similar or identical parts throughout the several 
views, and more specifically to figures 1 and 6 thereof, there is 
shown a timing distribution apparatus 10. The apparatus 10 
comprises a source 12 for producing a signal. The apparatus 10 
comprises a first filter 14 for removing jitter from the signal. 
The apparatus 10 comprises a second filter 16 for removing wander 
from the signal separate and apart from the first filter 14. 

Preferably, the first filter 14 includes a first tuneable 
directed digital synthesizer 18 connected to the source 12 for 
producing a clock signal derived from the signal from the source 
12. The source 12 preferably includes an oscillator 20 that 
produces the signal. Preferably, the first filter 14 includes a 
reference input clock signal mechanism 22 for providing a reference 
input clock signal with respect to the clock signal. 

The first filter 14 preferably includes a first 
comparison mechanism 24 which accumulates error between the clock 
signal and a reference input clock signal and produces an error 
correction signal to tune the direct digital synthesizer. 
Preferably, the first comparison mechanism 24 includes a 
microcontroller which accumulates the error between the clock 
signal and the reference input clock signal for a predetermined 
number of consecutive cycles, and applies dithering to the 
accumulated error to produce the error correction signal. 
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The second filter 16 preferably includes a second 
tuneable directed digital synthesizer 28 connected to the first 
filter 14 for producing a second clock signal from the first clock 
signal from the first filter 14. Preferably, the second filter 16 
5 includes a second comparison mechanism 3 0 which accumulates error 
between the first clock signal and the second clock signal and 
produces a second error correction signal to tune the second 
directed digital synthesizer. The first filter 14 preferably 
removes noise greater than 1 KHz from the signal and the second 
10 filter 16 removes noise less than 1 KHz from the signal. 

Preferably, the second comparison mechanism 3 0 includes 

""•4 a second microcontroller 32 which accumulates the error between the 

iy 

« first clock signal and the second clock signal for a predetermined 

M number of consecutive cycles and computes the second error 

J-;:15 correction signal. The first comparison mechanism 24 preferably 

3 includes a first counter 34 which receives the reference input 

it signal and counts a second predetermined number of cycles between 

f y 

n rising edges of the reference input clock signal. There is a 
iFI second counter 3 6 which receives the clock signal and counts the 
p20 second predetermined number of cycles between rising edges of the 
clock signal. There is a comparitor 38 which compares the counts 
of the first and second counters 34, 3 6 and reports differences in 
the counts every predetermined period to the first microcontroller 
26. 

25 Preferably, the reference input clock signal and the 

clock signal have a frequency of about 8 KHz, the second 
predetermined number of cycles is 8 0 MHz, the predetermined period 
where the comparitor 3 8 reports differences in the counts to the 
first microcontroller 26 is about 125 microseconds, and the 

30 predetermined number of cycles is 1024. The accumulated error 
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preferably includes a scaled error, and the first microcontroller 
2 6 determines scaled error according to 



ScaledError - K i * error[n] + K a * ^ error\i\ 

/=i 



where Ki is a coefficient for scaling the instantaneous error and 
5 K a is a coefficient. 

?3 Preferably, the first filter 14 and the second filter 16 

*U have an acceptable range of inputs that they will accept in regard 
to the signal from the source 12, which are outside of a 
p predetermined acceptable range. The signal preferably has a 
r ^10 nominal frequency and the acceptable range is +/-4.6 ppm away from 
Iff the nominal frequency and the predetermined acceptable range is 



M 
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Q The present invention pertains to a method for producing 

in 

a timing distribution signal. The method comprises the steps of 
C315 removing jitter from a signal with a first filter 14. Then there 
is the step of removing wander from the signal with a second filter 
16 separate and apart from the first filter 14. 

Preferably, the removing the jitter step includes the 
step of applying an error correction signal to a direct digital 
20 synthesizer of the first filter 14 by a first microcontroller 26 of 
the first filter 14 based on accumulated error between a reference 
input clock signal and a clock signal from the direct digital 
synthesizer. Before the removing the jitter step, there is 
preferably the step of producing the clock signal from the signal 
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from an oscillator 20. Preferably, the applying step includes the 
step of applying dither to the accumulated error. 

The removing wander step preferably includes the step of 
applying a second error correction signal to a second direct 
5 digital synthesizer of the second filter 16 by a second 
microcontroller 32 based on accumulated error for a predetermined 
period of time between the clock signal and a second clock signal 
from the second direct digital synthesizer. Preferably, before the 
applying dither step of the applying step, there is the step of 

a 10 computing an average error value. 

Q 
\Q 

N After the computing step of the applying step, there is 

JSj preferably the step of computing a scaled error value where 

XIZX 

: . 

r z 

^ ScaledError = K i * error[n] + K a * £ error\i\ 

1=1 

r Li 

In 

p where Ki is a coefficient for scaling the instantaneous error and 
C3l5 K a is a coefficient. Preferably, before the average error value 
computing step, there is the step of comparing counts of a first 
counter 34 counting a second predetermined number of cycles between 
rising edges of the reference input clock signal and of a second 
counter 3 6 counting the second predetermined number of cycles 
20 between rising edges of the clock signal. The removing jitter step 
preferably includes the step of accepting a range of inputs in 
regard to the signal which are outside of a predetermined 
acceptable range. 



25 



Referring to figure 4, the present invention pertains to 
a method for producing a timing distribution signal. The method 
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comprises the steps of producing the timing distribution signal, a 
first master signal and a second master signal with a master 
hardware system 40. Then there is the step of receiving the first 
master signal, second master signal and timing distribution signal 
5 at a back up hardware system which informs the backup hardware 
system 42 that the master hardware system 4 0 is a master over the 
backup hardware system 42, it is in either a failed or non-failed 
condition, and which the back up hardware system uses as a 
reference signal but the backup hardware system 42 does not 
10 transmit any timing distribution signal if it is not the master, 
respectively. Next there is the step of entering the master 
% q hardware system 40 in a. failed condition. Then there is the step 
of having the backup hardware system 42 immediately becoming the 
#5 master and continuing to transmit the timing distribution signal 
H15 that the master hardware system 4 0 was transmitting before the 
lp master hardware system 40 failed and stopped transmitting its 
s timing distribution signal, with the timing distribution signal 

l~ from the backup hardware system 42 aligned with the timing 

f U 

p distribution signal provided by the master hardware system 4 0 
^j2 0 before it failed so there is no phase discontinuity when the backup 
«jj hardware system 42 becomes the master and begins transmitting the 
timing distribution signal. 

The present invention pertains to a timing distribution 
apparatus 10. The apparatus 10 comprises a master hardware system 

2 5 4 0 and a backup hardware system 42 for the master hardware system 
40 that allows the master hardware system 40 to fail without any 
phase discontinuity. Each hardware system comprises a first filter 
14 for removing jitter from the signal. There is a second filter 
16 for removing wander from the signal separate and apart from the 

30 first filter 14, as described above. The master hardware system 40 
has a first master signal and a second master signal that are sent 
to the back up hardware system that informs the backup hardware 
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system 42 that the master hardware system 4 0 is a master over the 
backup hardware system 42 and, it is either in a failed or non- 
failed condition, respectively. The master hardware system 40 
produces a timing distribution signal that is sent to the backup 
5 hardware system 42 which the backup hardware system 42 uses as a 
reference signal for the backup hardware system 42 but the backup 
hardware system 42 does not transmit any timing distribution signal 
if it is not the master. When the master hardware system 40 enters 
a failed condition, the backup hardware system 42 immediately 
10 becomes the master and the backup hardware system 42 continues to 
transmit the timing distribution signal that the master hardware 
*S system 40 was producing before it failed with the timing 
% 4 distribution signal from the backup hardware system 42 aligned with 
the timing distribution signal produced by the master hardware 
M15 system 40 before it failed so there is no phase discontinuity. 

%U 

y \ 

g In the operation of the invention, the system allows a 

M wide range of both jittering and wandering inputs to be used as the 
IS source 12 for the timing distribution system. By using two stages 
In of filtering on a timing reference input, a high-quality output- 
*2*20 timing signal can be generated and distributed to the transmission 
elements in the network switch. Previous practice would have used 
a single stage of filtering in order to attempt to achieve the same 
goal, but this proved to be insufficient for this application. 
Another possible solution would have been to use a jitter 
25 attenuation circuit in a Line Interface Unit (LIU) . However, the 
jitter attenuation circuit in the LIU had temperature sensitivity 
and was, therefore, deemed insufficient for this application. By 
using two-stage filtering, the responsibilities of the filters are 
able to be subdivided so that the first stage filter can reduce the 
30 input jitter and add dithering. The dithering allows the second 
stage to more closely lock to the output of the first stage in the 
case that the input signal does not have any wander. The lower 
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frequency filter in the second stage can be used to knock out the 
wander in the input reference. The filtering function is shown in 
Figure 1 . 



The two filters have a similar implementation but with 
5 different coefficients used to control the strength of the filter. 
The first -stage filter accumulates error between the reference 
input clock signal and a tunable direct digital synthesizer (DDS) 
clock signal derived from a high precision oven controlled 
oscillator (OCXO) . Both of these input signals, which have a 
10 frequency of 8 kHz, are inputs to a separate counter. The counters 

£3 

track the number of 80 MHz cycles between the rising-edges of each 
M of the input signals. A comparison is made, and the difference is 
S reported every 125 microseconds to the microcontroller that 

L-J 

M controls the filter. The microcontroller accumulates this error 

^15 for 1024 consecutive cycles (approximately 1 second) before 

in 

~ computing an average error value for the time slice. This average 

H error value is used to compute a scaled error value in the formula 

ru 

below. Before a new value is written to tune the DDS, dither is 
IH added to the signal. This dithering either adds or subtracts 12.5 
^20 nanoseconds of phase from the signal in order to make it easier for 
the second stage to detect error in its input signal. Since the 
dither is added in one write to the DDS and subtracted in the next, 
there is no accumulative error added to the filtered signal. 

The second stage receives an 8 kHz signal from the first 
25 stage and an 8 kHz signal from a second DDS. As in the first 
stage, error is accumulated and read by the microcontroller. This 
is used to compute a tuning value for the DDS. The filter that is 
implemented in the second stage responds to much lower frequencies 
than the first stage in an effort to remove wander from the signal. 
30 The filter function is of the form 
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ScaledError = Ki * error[n] + Ka * ^ error[i] , 

where Ki is a coefficient for scaling the instantaneous error and 
K a is a coefficient for scaling the error that is accumulated since 
the timing reference was chosen by the system. The coefficients 
for the first stage are about 3 orders of magnitude larger than the 
coefficients for the second stage. 

The selector function provides a multiplexer to select 
one of six possible inputs. The choices are: the primary reference 
from the port cards, the secondary reference from the port cards, 
the global reference driven by the main TCM, one of the two BITS 
inputs, or the DPLL oscillator 2 0 output. Under normal operating 
conditions, the reference would be selected from the primary, 
secondary, or one of the two BITS inputs. The DPLL oscillator 20 
output is selected when the TCM is in FreeRun or Holdover. The 
global reference is selected by the standby TCM in order to 
synchronize with the main TCM's output. 

The input reference that is selected is based on the 
value written in the Input Select Register (Register 3) . The 
selected clock is used as the reference for the DPLL as shown in 
figure 6, as well as for the analog PLL, which generates the 
transmitted BITS, clock. (For diagnostic purposes, the output of 
the DPLL can be selected instead as the source 12 for the 
transmitted BITS clock.) 

The digital filter function is implemented using two 
Motorola MC68HC16Z1 microcontrollers. The microcontrollers are 
responsible for qualifying the incoming clock, filtering to 
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stabilize the clock, and for reporting the status of the current 
operating mode. The digital filter implements moving average and 
FIR filters to smooth short-term variations in phase. This is 
intended to reduce jitter. The digital filter implements a PID 
5 filter to correct long-term variations in phase. This is intended 
to reduce wander. The first microcontroller 2 6 (first stage) 
reduces jitter, while the second microcontroller 32 (second stage) 
reduces wander. A flow chart is shown in Figure 2 that displays 
the basic operation for both stages. 



10 The system uses a high precision OCXO as the basis for 

"r its timing qualification, which allows it to have a much tighter 

%y 

N! range when qualifying signals. Other timing distribution systems 

iii 

:z use the clock that is held over from the previous valid reference 

Ji4 when qualifying a new reference. If the previous reference were 

^15 lost because of an off frequency condition, this "holdover" clock 

in 

would be several ppm off of the nominal frequency. Since this 
M clock is used as the basis for qualifying new references, the 
» window for acceptance has to be much larger than the actually 
if! acceptable range for the new reference from the nominal frequency. 
^20 If the acceptable variance in a reference source 12 were +/- 4.6 
ppm, then the range for the old system would have to be at least 
four times as wide in order to accommodate the case where the 
holdover value is +4.6 ppm and the new reference is -4.6 ppm away 
from the nominal frequency and the opposite case. Further, this can 
25 cause the timing distribution system to attempt to lock to a signal 
that is not valid since a signal that is +9 ppm off nominal would 
be considered valid if the holdover value is +4.6 ppm off nominal. 
This is shown in Figure 3 . 



30 



In the system, the comparison point is always centered 
within the tolerance of the OCXO. By using a free running 
oscillator 20 as the comparison source 12, it is possible to 
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tighten the range over which a new reference is validated. This 
range is equal to the range specified by the specification (+/- 4.6 
ppm) plus the variance inherent in the OCXO (+/- 1.2 ppm) plus some 
margin for error. Having a tighter range with a stable center 
point means that there will be no instances in which the reference 
would be initially qualified and then rejected after it has passed 
its initial qualification unless the reference source 12 
subsequently drifts away from the nominal frequency. This provides 
improved performance in the system and allows for fewer transitions 
between references, which in turn provides for a more stable 
system. Most importantly, the system is able to recover from off 
frequency conditions without the need for human intervention, which 
would be necessary for systems which base their comparison on the 
holdover value . 

The system provides a means by which the frequency of the 
standby reference signal is monitored prior to a failure of the 
master reference signal. In previous solutions, the standby signal 
was merely checked for alarm conditions such as loss of signal, 
loss of frame, etc. without any comparison of the frequency being 
made. In systems where the frequency was compared, it was compared 
to the holdover value of the system, which means that it could be 
significantly off frequency such that an invalid signal could be 
considered valid (see argument made in part 2) . By using the free 
running value of the local oscillator 20, it is possible to 
independently monitor the standby frequency prior to it being 
qualified on a failure of the primary reference. This provides the 
advantage of having a signal that is pre-qualif ied correctly, 
thereby preventing the system from continually changing references 
if an invalid reference became the primary reference signal. The 
implementation is similar to the implementation of the first stage 
filter of the active reference described in part 1, the difference 
being that no attempt is made to actually lock to the standby 
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reference or to tune the DDS . The signal is merely monitored for 
frequency validity. 

The system allows for revertive switching to occur in the 
system. Given that there is a primary reference and a standby 
5 reference in a timing distribution system, revertive switching 
provides priority to the primary reference being the active timing 
reference even if it has previously failed. In the case where the 
primary reference fails, the standby reference becomes active. 
When revertive switching is enabled, the primary reference must 

.„10 become the active timing reference if it is ever determined that it 
has recovered from its failure condition and has become a valid 

'-4 reference source' 12 . The system is able to accomplish this because 

a j f 

m not only are the alarm conditions of the non-active reference are 

M= monitored at all times, but also the frequency of the non- active 

?il5 reference is monitored at all times. A change in state from failed 

2 to valid is recognized and communicated to the system processor 

l~ which initiates the revertive switch in the case that the primary 

H reference signal has recovered. Previous systems were not able to 

i?l properly implement revertive switching since they were not able to 

ij 

?=2 0 monitor the frequency of the non-active reference properly. The 

is* 

implementation is the same as described above. 

The system allows a failure without any phase 
discontinuity in the case that the master hardware system 4 0 incurs 
a failure and an identical backup hardware system 42 is installed. 

25 The master hardware system 4 0 has two signals that tell the backup 
that it is the master and that it is in a non- failed condition, 
respectively. If the master enters a failed condition, the backup 
hardware system 42 immediately becomes the master and continues to 
transmit the clock that the previous master was distributing to the 

30 network. It is able to do this by using the clock being 
transmitted by the master as the reference source 12 for the backup 



hardware system 42. Even though the backup hardware system 42 is 
not exporting its generated timing signal to the timing network, 
the reference is still being generated so that it can be 
immediately available in the event that the master hardware system 
40 fails. Additionally, the phase relationship between the timing 
reference from the master hardware system 40 and the generated 
timing signal are aligned in order to ensure that there is no phase 
discontinuity from when the master system fails and stops 
transmitting its generated timing signal to when the backup 
hardware system 42 takes over and starts transmitting its generated 
timing reference. Figure 4 shows how the signals are connected 
between the two hardware systems . 

The system provides switching between references of like 
frequency without incurring any phase discontinuities in the output 
signal. This is accomplished by momentarily holding the generated 
timing reference at a "holdover 1 value while the. new reference is 
being accepted as the active timing reference. Since the holdover 
value is known to be within tolerance, the value can be used for 
the short period of time that is necessary for the standby 
reference to be qualified as the active. By going to the holdover 
value, any phase discontinuities are able to be bypassed that would 
otherwise occur if one were to directly transfer from the active to 
the standby reference. The flow chart in Figure 5 shows the steps 
involved in the transfer. It also shows the process for 
implementing revertive switching. 

Although the invention has been described in detail in 
the foregoing embodiments for the purpose of illustration, it is to 
be understood that such detail is solely for that purpose and that 
variations can be made therein by those skilled in the art without 
departing from the spirit and scope of the invention except as it 
may be described by the following claims. 



